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Abstract 

We show how to construct non-equilibrium thermodynamics for systems too small to be 
considered thermodynamically in a traditional sense. Through the use of a non-equilibrium 
ensemble of many replicas of the system which can be viewed as a large thermodynamic 
system, we discuss the validity of non-equilibrium thermodynamics relations and analyze 
the nature of dissipation in small systems through the entropy production rate. We show 
in particular that the Gibbs equation, when formulated in terms of average values of the 
extensive quantities, is still valid whereas the Gibbs-Duhem equation differs from the equa- 
tion obtained for large systems due to the lack of the thermodynamic limit. Single- molecule 
stretching experiments are interpreted under the prism of this theory. The potentials of mean 
force and mean position, now introduced in these experiments in substitution of the ther- 
modynamic potentials, correspond respectively to our Helmholtz and Gibbs energies. These 
results show that a thermodynamic formalism can indeed be applied at the single-molecule 
level. 

Keywords: small systems, nonextensivity, thermodynamics, non-equilibrium thermody- 
namics. 
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1 Introduction 



Thermodynamics [1] can only be applied to systems with an infinite number of particles dis- 
tributed in an infinite volume with a constant density, a situation referred to as the thermo- 
dynamic limit. Under these circumstances one may adopt a coarse description of the system 
ensuring the existence of extensive quantities and justifying the absence of fluctuations. The 
thermodynamic limit [2] can be asymptotically approximated through statistical mechanics and 
the results from different statistical ensembles converge. It is then said that thermodynamics 
deals with large-scale systems. 

The lack of a thermodynamic limit has important consequences for the behavior of the system. 
Scaling down the size leads to a very different scenario, in which contributions to the energy of the 
system not present in the thermodynamic limit, such as surface energy, may show up, thereby 
breaking extensivity and making a normal thermodynamic treatment impossible. A typical 
example is a small cluster of N particles whose Gibbs energy is given by [3] 

G = fiN + aN? (1) 

with n the chemical potential, a an arbitrary function of the intensive parameters and j3 < 1 an 
exponent. When the cluster contains a large number of particles, the second contribution be- 
comes much smaller than the first and can be neglected. At this limit one obtains the well-known 
thermodynamic relation G = fiN for which the chemical potential is the Gibbs energy per parti- 
cle. On the other hand, for clusters containing a smaller number of particles both contributions 
must be considered, which makes the Gibbs energy non-extensive. As a consequence thermody- 
namics does no longer apply. Without a coarse description, fluctuations become important and 
play a role in the characterization of the system. 

Despite this relevant feature, a thermodynamic treatment of small system is still possible. The 
way to proceed was proposed by Hill [3] for systems at equilibrium and was subsequently applied 
to different situations such as biochemical cycle kinetics [4], [5], open metastable systems [6], 
entropy-enthalpy compensation effects [7], [8] and critical behavior of ferromagents [9]. It was 
later referred to as nano-thermodynamics [10]. Given a small system, the ensemble of many of 
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its replicas becomes a large system having the usual thermodynamic behavior. To restore the 
form of the Euler equation, the expression of the Gibbs energy in terms of the chemical potential, 
one can express the Gibbs energy as 

G = j2N (2) 

where the chemical potential ju, according to Eq. is given by [3] 

fl = fi + aN?- 1 (3) 

Both chemical potentials thus coincide at the thermodynamic limit. It can also be shown that 
thermodynamic quantities defined for different ensembles, may not be equivalent [3]. 

Thermodynamics of small systems has been formulated at an equilibrium state [3]. In many 
experimental situations, however, instead of being in a quiescent state, the system evolves in time 
adopting different non-equilibrium configurations. This situation is commonly found in kinetic 
processes such as nucleation [11] and growth [12] of small clusters, in noncovalent association 
between proteins [13] and in active transport through biological membranes [14], [15]. It is our 
purpose in this paper to develop the non-equilibrium thermodynamics of small systems offering 
an interpretation of the non-equilibrium thermodynamics concepts as well as identifying the role 
played by dissipation. 

The paper is organized as follows. Section 2 presents the main ideas of Hill's thermodynamics 
of small systems. In Section 3 we proceed with the study of small systems outside equilibrium 
by introducing the non-equilibrium ensemble of replicas. The non-equilibrium thermodynamics 
relations and the entropy production of small systems are obtained in Section 4. In Section 5, we 
apply the non-equilibrium thermodynamics of small systems developed to give a thermodynamic 
interpretation of single-molecule experiments. Finally, in the conclusions section we summarize 
our main results and discuss about perspectives of the theory presented. 

2 The thermodynamic system of replicas 

A small system can be made large by constructing an ensemble of identical, independent replicas. 
This procedure ensures the validity of thermodynamic relations in the ensemble [3]. Consider a 
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group with K number of these replicas with total energy Utot = KU, entropy Stot = KS and 
volume Vtot = KV. Here U is the average internal energy, S is the entropy and V the average 
volume per replica. The total quantities are extensive by definition. According to the first law, 
we can change the energy by adding heat or work to the ensemble, 

dUtot = dQ + dW (4) 

At reversible conditions, the added heat Q rev follows from the definition of the entropy 

dQ rev 

dStot = — ^— (5) 

whereas the irreversible heat enters into the entropy production. 

Let us assume that the system has a constant number of particles A and is in contact with 
pressure and heat reservoirs keeping its pressure p and temperature T constant. Changes in the 
energy of the ensemble are given by 

dU tot = TdS tot - pdV tot + fiKdN + XdK (6) 

Here fj, is the chemical potential of a large system of A particles, with K = 1. The last term 
accounts for the energy raise by adding more replicas to the ensemble and also represents an 
increase of entropy since the total number of particles of the ensemble can spread over a larger 
number of replicas. This term is not present in a large system for which K = 1. 

The energy of the ensemble follows by integrating this expression, keeping A, p and T con- 
stant: 

U tot = T S tot -pV tot + XK (7) 
and the average energy is in light of the relation between total and average values given by 

U = TS - P V + G (8) 

where we have identified X with the Gibbs energy G. Extensivity can be restored by expressing 
this quantity as 

G = /2N (9) 
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with /I the corresponding chemical potential. Expression Q can also be written as 

U = TS - pV + fiN + — (i)N (10) 

This equation does not correspond to the one derived for a thermodynamic system. Devia- 
tions from the large-system behavior are due to the presence of the term (// — fj) vanishing at 
the thermodynamic limit in which G = fxN. Variations of the mean energy value are then given 

by 

dU = TdS -pdV + fidN (11) 

showing that mean value variations obey the same thermodynamic relation as for a large system. 
A similar analysis can be performed for constant N, V and T. One obtains in this case 

dUtot = TdStot - pKdV + fiKdN + AdK (12) 

where A = U — TS is the Helmholtz energy which differs from — pV + fiN, the value encountered 
in thermodynamics. The Gibbs equation becomes 

dU = TdS — pdV + /jidN (13) 

The fact that the spreading of particles of the ensemble over the different replicas depends on 
the conditions imposed on the system makes the thermodynamic quantities for small systems 
different when these conditions change. Thermodynamic relations thus depend on the ensemble 
used and consequently on the measurement techniques for the experiments. 

3 The statistical ensemble of non-equilibrium replicas 

Application of external forces or gradients move the system from the reference state driving 
it through different non-equilibrium configurations described by the set of coordinates x and 
characterized by the probability distribution function P(x,t). The coordinates may for example 
represent the number of particles of a cluster or the configurations of a polymer or may in 
general be a reaction coordinate or an order parameter characterizing the state of the system. 
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The ensemble of K replicas becomes under the presence of the external driving force a non- 
equilibrium ensemble whose evolution in time is described by the probability distribution function 
P(T,t), with T = (xi, ..,xk) a point in the phase space of the ensemble. Since the elements of 
the ensemble are by definition independent systems, we have P(T,t) = P{xi)...P(xk)- The 
time-dependent entropy of the ensemble is, according to the Gibbs entropy postulate, given by 



where S to t,o is the entropy of the ensemble in the reference state, Pq(T) the probability distri- 
bution of the ensemble in that state and ks the Boltzmann constant. Using the fact that the 
replicas are independent we can rewrite this equation as 



where Po(x) denotes the probability distribution of the system at the reference state. The term 
within brakets of this expression represents the change in the entropy of one replica system with 
respect to its value at the reference state. Our construction then preserves the additive nature 
of the non-equilibrium entropy. 

4 Non-equilibrium thermodynamics of small systems 

Based on the statistical expression for the entropy of the ensemble found in the previous section, 
we will proceed to formulate the non-equilibrium thermodynamics of small systems by deriving 
the relations common in non-equilibrium thermodynamics and by giving the expression for the 
entropy production. 

4.1 Thermodynamic relations 

We will assume that in the reference state, the system is at local equilibrium. Changes in the 
non-equilibrium entropy during the evolution in time of the ensemble, follows from the expression 
obtained for the non-equilibrium entropy. We have 




(14) 




(15) 




(16) 
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Entropy variations in the local equilibrium state have the same form as those at equilibrium 
given through Eq.(l). Using this result in Eq.(6) one obtains 

TdStat(t) = dU tot (t) + P dV tot (t) - NjldK - fi KdN - K (k B T5 f P(x, t) In J^<b) (17) 

where no is the chemical potential of the system at the local equilibrium state. The variations 
of the last term can be expressed as 

k B T6 [ P(x, t) In P jf.' 1 1 } dx = [ /j,Jx,t)SP(x,t)dx - [ n SP{x,t)dx (18) 
J Pq{x) J J 

where we have defined the chemical potential along the x-coordinate as 

Hx{x,t) = k B Tln^^-+fi (19) 
Po\ x ) 

Using this last expression in lfT7|l together with the normalization of the probability distribution 
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one arrives at the Gibbs equation of the ensemble 

T d S M = m M+pd V M -Nm-Kj^P dx (21) 

giving entropy changes at the local equilibrium state of the ensemble. We suppressed the time 
and x dependence of the variables to simplify the notation. The last term integrates all entropy 
changes due to variations of the configurations in x-space of the system. Using now the relations 
Stot = KS, Utot = KU and Vtot = KV and equation ((HI), we obtain from the Gibbs equation 

TdS = dU + pdV - J fi x 5Pdx (22) 

which shows that a Gibbs equation for small systems is valid when formulated in terms of 
average values. The probability distribution function is the average of the microscopic density 
distribution and can be expressed as P(x,t) =< 5(x — x(t)) >, where the average is taken over 
the possible realizations of the Langevin force, for a given initial condition. This probability is 
governed by a Fokker-Planck equation which for a thermodynamic system can be derived within 
the framework of mesoscopic non-equilibrium thermodynamics [16], [17]. 



The Gibbs-Duhem equation relating variations of the intensive parameters can be obtained 
from Eqs. ©,1201) and 

-SdT + Vdp - Nd/2 = J (p - fi x )5Pdx (23) 

This equation differs from the one derived for large systems and tends to it at the thermodynamic 
limit where fi, and fj, x coincide. The sign of the integral depends on the type of process the system 
undergoes. 

4.2 Entropy production 

The Gibbs equation l(22)l and the first law of thermodynamics, formulated in terms of average 
values 

dU = dQ-p ext dV (24) 

where Q is the heat supplied and p ex t the external pressure imposed to the system, can be 
combined to obtain the rate of entropy change 

dS ldU pdV If dP , 

— = h — / u x ^—dx (25) 

dt T dt T dt T J dt { ' 

This equation can be rewritten in the well-known general form 

- = J S + . (26) 

where 

T B dt K ' 

represents the entropy exchange with the environment, and Tb is the temperature of the thermal 
bath. The second contribution is the entropy production rate 

-=(l-^-)^- + P -^^-l I J^dx (28) 
\T T B J dt T dt T J dx v J 

which has to be non-negative due to the second law of thermodynamics. To obtain this equation, 
in Eq. l(25|) we have used the continuity equation for the probability distribution function 



with J the probability current along the x-coordinate, and then performed a partial integration 
neglecting boundary terms. As the probability distribution, this current also represents an 
average value. 

The first two contributions of the entropy production originate from the interaction with 
the thermal bath due to the fact that the temperature and the pressure of the system may not 
coincide with the corresponding quantities of the bath. The third contribution results from the 
underlying diffusion process along the x-coordinate. When this process is very fast, the system 
reaches a quasi- equilibrium state almost immediately In this state the current does not depend 
on the coordinate and the last contribution becomes proportional to JAfi. From the entropy 
production one can now infer expressions for the rates, as is usually done in non-equilibrium 
thermodynamics [18]. 

5 Thermodynamics of single-molecule measurements 

Polymer stretching experiments have recently been performed to analyze the validity of thermo- 
dynamics for measurements made on single molecules arriving at the conclusion that when the 
system is too small the usual thermodynamic relations are no longer valid and a thermodynamic 
treatment is less useful [19]. These experiments give different results when the end-to-end dis- 
tance of a single-molecule is held fixed and the force fluctuates, compared to when the force is 
fixed and the end-to-end distance fluctuates. These differences should vanish in the thermody- 
namic limit of an infinite length. A single molecule is a particular case of a small system. We 
shall show in this section that the theory we propose in this paper provides a thermodynamic 
interpretation of the experimental measurements. For this purpose, we will assume that the set 
of measurements performed as a function of time defines the ensemble of replicas. As indicated 
by the experiments, the two types of experiments must be analyzed using different environmental 
variables. In both cases iV and T are constant for the single molecule. There are two ensembles: 
one in which the applied force is constant and the other for which the end-to-end distance is 
constant. 
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Isometric experiments 

In the case in which the end-to-end distance I and the temperature T are externaly controlled, 
energy variations in the ensemble of K replicas are, in accordance with (11211 . given by 



where the tensile applied force / is interpreted as the change in the internal energy of the ensemble 
with respect to the elongation of the polymer per replica, keeping the entropy and the number 
of replicas constant. In these experiments one employs a single replica and measures a force 
which fluctuates as a function of the time. Averaging this quantity over the time is equivalent 
to ensemble averaging and therefore gives the / we need. Integration of this expression for a 
constant length leads to 



Using the definitions Utot = KU and Stot = KS in this relation we can identify A = U — TS 
with the Helmholtz energy previously defined. A is the change of the internal energy due to 
increasing the number of replicas by one, keeping Stot and I constant. Variations of the average 
energy then follows from our previous expressions 



The Gibbs-Duhem equation can be derived from Eq. l(3*2*|l and the definition of the Helmholtz 
energy, thus obtaining 



dUtot = TdStot + fKdl + AdK 



(30) 



Utot = TStot + AK 



(31) 



dU = TdS + fdl 



(32) 



SdT + dA = fdl 



(33) 



If we now define the Helmholtz energy per unit of length 




(34) 



we obtain the Gibbs-Duhem equation 



SdT + Idf = (/ - f)dl 



(35) 



From Eq. it follows that 




(36) 
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from which one finds the expression for the Helmholtz energy 

A(T,l)= I* f(T,l')dl' (37) 
Jo 

where the integration constant is equal to zero. The Helmholtz energy is therefore equal to the 
potential of mean force introduced by Keller et al. [19]. It follows from this expression, that the 
quantity f{l) is the average of the force /(/) over the lengths between zero and I and is therefore 
generally different from /. This difference is in relationship with its dependence on the polymer 
elongation. At the thermodynamic limit of a very large /,/—>/. At this limit, Eq. (|3*5|l becomes 
the usual Gibbs-Duhem equation of thermodynamics. 

In order to obtain the entropy production we will use the first law 

dU = dQ + f ext dl (38) 

In this equation the first term on the right hand side gives the heat which enters the average 
replica from the heat bath. The second term is the work done by an external force when one 
changes the length of the polymer, which is the same for all replicas in the isometric experiments. 
Combined with Eq. l(3*2|l the first law yields the entropy rate of change 

dS _ 1 dQ 1 dl 

-dJ-TlI + T {fext ~ f) Jt (39) 

Considering that the temperature of the bath is equal to that of the system, we can identify ^ -3 
with the entropy flux into the system and find for the average entropy production per replica 

= \{fe.t-f)j t (40) 

In the isometric equilibrium experiments by Keller et al. [19] the length of the polymer is kept 
constant and f ex t = f. In that case the entropy production vanishes. If one proceeds to change 
f ex t one can describe the system using the linear force flux relation 

fext ~ f = (41) 

where ^ is the friction coefficient. 



11 



Isotensional experiment 

In the case in which the applied force / and the temperature T are externaly controlled, energy 
variations in the ensemble of K replicas are given by 

dU tot = TdS tot + fdl tot + GdK (42) 

We define the average length of a replic by lf t = Kl. The Gibbs energy is 

G = U — TS — fl = A — fl (43) 

In the thermodynamic limit G = 0. Following the steps indicated in the previous case, we obtain 
the Gibbs equation 

dU = TdS + fdl (44) 

and the Gibbs-Duhem equation 

-SdT - Idf = dG (45) 
from which we obtain the average elongation length 

--(f), 

In the experiment one keeps / constant and measures I as a function of time. Averaging over 

time gives the ensemble average of I, which is equal to the I we use. We conclude that 

<•/. 
io 

where X(T, f) is the Gibbs energy in the presence of a force which coincides with the potential of 
mean position introduced by Keller et al. [19]. This quantity gives information about the mean 
elongation of the macromolecule for different values of the force. 

In order to obtain the entropy production, we use the first law in the following way 

dU = dQ + f ext dl (48) 

Proceeding as in the previous case, we obtain the entropy production 

O = \ (fext ~f)f t (49) 



G(T, f) = - [ f l(T, f)df = X(T, f) (47) 
Jo 
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In the isotentional equilibrium experiments by Keller et al. [19] f ex t and / were kept equal and 
constant while the average length of the polymer was also constant. In that case the average 
entropy production vanishes. If one proceeds to change f ex t one can describe the system using 
the linear force flux relation 

fext ~ f = C| (50) 

Comparing this equation to Eq.lj^Hl we see that while Eq. (|^T|) contains the average force / and 
the controlled length I, that Eq. l(5T)|l contains the controlled force / and the average length I, In 
the thermodynamic limit both equations become the same. 

Calculating the Gibbs energy gives generally different results depending on whether we use 
isometric or isotensional ensembles. As previously seen, when the force is constant, G = A — fl 
whereas for a constant elongation, we can construct G from A giving A — fl. Only when the 
force is linear in the elongation, or equivalently when the Helmholtz energy is quadratic, both 
expressions coincide. Results obtained from both of these ensembles would then be equivalent 
only when the force is harmonic [19]. 

6 Conclusions 

In this paper we have shown how non-equilibrium thermodynamics can be constructed for the 
irreversible evolution of small systems. By considering a non-equilibrium ensemble of many 
replicas as a large, and therefore thermodynamic, system we can define extensive variables and 
then to use well-known thermodynamic concepts and relations to apply these to small systems. 
For different types of environmental variables one can derive the equivalent Euler, Gibbs and 
Gibbs-Duhem equations and the entropy production from which dissipation in small systems can 
be analyzed. The thermodynamic relations obtained agree at the thermodynamic limit with the 
ones of classical thermodynamics. 

We have applied the formalism developed to interpret stretching experiments performed with 
a DNA molecule. It has been argued that the thermodynamic concepts and relations are less 
useful in these experiments and that the potentials of mean force and mean elongation should 
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replace the Helmholtz and Gibbs energies [19]. When we proceed along the lines indicated, we 
can define extensive quantities and show that thermodynamics does apply on the single-molecule 
level. We have shown that these potentials introduced in the experiments coincide with our 
expressions for the Helmholtz and Gibbs energies and that the thermodynamic relations depend 
on the type of ensemble used. Our formalism gives the expression for the entropy production 
corresponding to the experimental situations discussed. 

Our analysis may provide a thermodynamic basis for experiments performed on small systems 
which operate under non-equilibrium conditions for which the absence of the thermodynamic 
limit and the importance of the fluctuations may constitute relevant factors in the characteriza- 
tion of their equilibrium and dynamical properties. Clusters, single molecules, small pumps and 
motors are cases where our theory could ystematicaly be applied. 
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